Modern Nonparametric Statistics: Going Beyond Asymptotic Minimax
نویسندگان
چکیده
During the years 1975 1990 a major emphasis in nonparametric estimation was put on computing the asymptotic minimax risk for many classes of functions. Modern statistical practice indicates some serious limitations of the asymptotic minimax approach and calls for some new ideas and methods which can cope with the numerous challenges brought to statisticians by modern sets of data. Mathematics Subject Classification (2000): 62Gxx. Introduction by the Organisers The workshop took place during the period March 28 April 2 and, as usual, talks were planned from Monday morning to Friday morning (most participants leaving on Friday afternoon) with a break on Wednesday afternoon for the traditional walk to Saint-Roman. There were finally 48 participants, due to some late cancellations. Unfortunately, Iain Johnstone could not attend the meeting since he had a very important committment in the US with the NSF during that week. However, he could participate quite actively in the organization up to the last minute since we, organizers, had the opportunity to meet together during a previous workshop and also exchange extensively by e-mail through which the list of participants and talks and all final details were set up. Therefore we were really three organizers and the success of the meeting should be put on the three of us. Actually, the list of speakers and the schedule of the talks were ready before our arrival and only minor changes 884 Oberwolfach Report 16/2010 were made during that week. This precise schedule can be found at the end of our report. During the years 1975 1990 (roughly speaking) a major emphasis in nonparametric estimation was put on computing the (possibly asymptotic) minimax risk for many classes of functions, starting from the simplest Hölder classes to the more sophisticated Besov balls in the beginning of the 90’s. It was clear, at that time, that this minimax point of view was quite pessimistic, since it was directed towards the worse case and also unrealistic, since one never knows to which smoothness class (or other specific class) the true parameter does belong. Nevertheless, this approach allowed to design useful estimators, which could be more or less practically calibrated (by cross-validation for instance) and provided some benchmarks for the performance of a given method. Then, by the beginning of the 90’s (approximately), started an important movement towards what is now called adaptation, either to some smoothness class or to the specific function that was to be estimated. This was made via different tools like Lepski’s method, the use of localized basis and thresholding, model selection . . . More recently, many new methods (aggregation of estimators, Lasso, etc.) appeared in order to cope with the numerous challenges brought to statisticians by modern sets of data and the huge progress of computing : huge data sets or situations where the number of unknown parameters is much larger than the number of data, together with some sparsity assumption. This also coincides with an important renewal of Bayesian methods due to much better and powerful computing facilities. Workshop organization In view of the importance of the numerous new techniques that are presently studied and used to solve the challenges offered by the modern sets of data, we decided that the main purpose of the workshop would be to expose many young researchers to those new techniques. We invited a number of confirmed specialists and experts together with younger professionals, PhD. students, postdocs, new assistant professors, in order to get a mix of generations and experiences. We also selected 5 senior professors to give longer talks (one hour and a half, one each morning) in order to develop their subject. These persons were especially asked, several months before the workshop, to deliver these special conferences. We also spent a lot of time and discussion in order to select the talks among the proposals by the participants in order to keep a maximal coherence between the subjects and keep the level as high as possible, finally limiting the number of talks to 24, including the five major ones mentioned above, and avoiding the multiplication of short talks. All normal talks were of 45mn, with the exception of the last morning since it was asked to us by the MFO organization to shorten the session for an early lunch (apparently for Easter vacation). It was also an occasion for us to invite an unusually large number of participants (mostly young researchers and some more senior French) that visited the MFO for Modern Nonparametric Statistics: Going Beyond Asymptotic Minimax 885 the first time, which gave them an occasion to discover this very nice place, the wonderful library, the numerous working facilities and the excellent MFO organization (as usual). We tried, as much as possible, to organize our 8 sessions around themes like Model Selection, Adaptive Density Estimation, High-dimensional Data and Sparsity, Statistics for Processes, Nonparametric Bayesian Methods, with also some talks by young and promising researchers which were given exactly the same time as the more senior ones. Modern Nonparametric Statistics: Going Beyond Asymptotic Minimax 887 Workshop: Modern Nonparametric Statistics: Going Beyond Asymptotic Minimax
منابع مشابه
Nonparametric statistical inverse problems
We explain some basic theoretical issues regarding nonparametric statistics applied to inverse problems. Simple examples are used to present classical concepts such as the white noise model, risk estimation, minimax risk, model selection and optimal rates of convergence, as well as more recent concepts such as adaptive estimation, oracle inequalities, modern model selection methods, Stein’s unb...
متن کاملStatistical Topology via Morse Theory Persistence and Nonparametric Estimation
In this paper we examine the use of topological methods for multivariate statistics. Using persistent homology from computational algebraic topology, a random sample is used to construct estimators of persistent homology. This estimation procedure can then be evaluated using the bottleneck distance between the estimated persistent homology and the true persistent homology. The connection to sta...
متن کاملEstimation with Univariate “mixed Case” Interval Censored Data
In this paper, we study the Nonparametric Maximum Likelihood Estimator (NPMLE) of univariate “Mixed Case” interval-censored data in which the number of observation times, and the observation times themselves are random variables. We provide a characterization of the NPMLE, then use the ICM algorithm to compute the NPMLE. We also study the asymptotic properties of the NPMLE: consistency, global ...
متن کاملBayesian Aspects of Some Nonparametric Problems
We study the Bayesian approach to nonparametric function estimation problems such as nonparametric regression and signal estimation. We consider the asymptotic properties of Bayes procedures for conjugate (=Gaussian) priors. We show that so long as the prior puts nonzero measure on the very large parameter set of interest then the Bayes estimators are not satisfactory. More specifically, we sho...
متن کاملMinimax Kernels for Nonparametric Estimation
SUMMARY The minimax kernels for nonparametric function and its derivative estimates are investigated. Our motivation comes from a study of minimax properties of nonparametric kernel estimates of probability densities and their derivatives. The asymptotic expression of the linear maximum risk is established. The corresponding minimax risk depends on the solutions to a kernel variational problem,...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010